Statistical Natural Language Processing
ثبت نشده
چکیده
4.0 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 199 4.1 Preliminaries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 200 4.2 Algorithms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201 4.2.1 Composition . . . . . . . . . . . . . . . . . . . . . . . . . 201 4.2.2 Determinization . . . . . . . . . . . . . . . . . . . . . . . 206 4.2.3 Weight pushing . . . . . . . . . . . . . . . . . . . . . . . 209 4.2.4 Minimization . . . . . . . . . . . . . . . . . . . . . . . . 211 4.3 Application to speech recognition . . . . . . . . . . . . . . . . . 213 4.3.1 Statistical formulation . . . . . . . . . . . . . . . . . . . 214 4.3.2 Statistical grammar . . . . . . . . . . . . . . . . . . . . . 215 4.3.3 Pronunciation model . . . . . . . . . . . . . . . . . . . . 217 4.3.4 Context-dependency transduction . . . . . . . . . . . . . 218 4.3.5 Acoustic model . . . . . . . . . . . . . . . . . . . . . . . 219 4.3.6 Combination and search . . . . . . . . . . . . . . . . . . 220 4.3.7 Optimizations . . . . . . . . . . . . . . . . . . . . . . . . 222 Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
منابع مشابه
Using Generalized Language Model for Question Matching
Question and answering service is one of the popular services in the World Wide Web. The main goal of these services is to finding the best answer for user's input question as quick as possible. In order to achieve this aim, most of these use new techniques foe question matching. . We have a lot of question and answering services in Persian web, so it seems that developing a question matching m...
متن کاملروش جدید متنکاوی برای استخراج اطلاعات زمینه کاربر بهمنظور بهبود رتبهبندی نتایج موتور جستجو
Today, the importance of text processing and its usages is well known among researchers and students. The amount of textual, documental materials increase day by day. So we need useful ways to save them and retrieve information from these materials. For example, search engines such as Google, Yahoo, Bing and etc. need to read so many web documents and retrieve the most similar ones to the user ...
متن کاملA Survey on Statistical Approaches to Natural Language Processing
This survey attempts to catch up with the recent increasing interests in statistical approach to natural language processing based on large corpora. First of all, a historical overview traces back to 1950s when Noam Chomsky proposed his phrase structure transformation grammar and rejected the Markov process natural language modeling. With the development of large corpora and language modeling i...
متن کاملAdaptive Natural Language Processing
In the past decades of NLP, there has been a steady shift away from rule-based, linguistically motivated modeling towards statistical learning and the induction of unsupervised feature representations. However, natural language components used in today’s NLP pipelines are still static in the sense that their statistical model or rule-base is created once, then subsequently applied without furth...
متن کاملStatistical Language Models and Information Retrieval: natural language processing really meets retrieval
Traditionally, natural language processing techniques for information retrieval have always been studied outside the framework of formal models of information retrieval. In this article, we introduce a new formal model of information retrieval based on the application of statistical language models. Simple natural language processing techniques that are often used for information retrieval – we...
متن کاملOn Statistical Methods in Natural Language Processing
What is a statistical method and how can it be used in natural language processing (NLP)? In this paper, we start from a definition of NLP as concerned with the design and implementation of effective natural language input and output components for computational systems. We distinguish three kinds of methods that are relevant to this enterprise: application methods, acquisition methods, and eva...
متن کامل